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METHOD AND DEVICE FOR DETECTING THE ORIENTATION OF AN IMAGE 

The invention relates to a device and a process for detecting the 
orientation of an image in a set of images. 

The invention relates more generally to the automatic detection of the 
5 orientation of an image that may possibly also contain text. 

Like scanners, digital cameras generate photos which are often viewed 
on a screen, such as a computer screen. These images may be viewed 
correctly, that is to say in the right orientation or in a sense that does not allow 
10 the user to view them without having to turn his head to the left or to the right, 
or even to lower his head. 

Specifically, sensing apparatus, such as digital cameras, can capture 
images in several senses, and in particular it is not uncommon for a user to 
15 take some of his photos in portrait mode and others in landscape mode. The 
photos thus taken are then transferred to a computer and all viewed in the 
same sense. Some will therefore be correctly viewed while others will require 
a 90, 180 or 270 degree rotation to be viewed correctly. 

20 Certain sensing devices and in particular certain digital cameras 

possess orientation sensors that detect a rotation of the objective and transmit 
a rotation cue obtained from the sensor with the image. This allows the 
viewing device, by virtue of the rotation cue, to automatically perform a 
rotation of the image so that the latter appears in the correct sense. 

25 

Other devices use methods for extracting the low-level or high-level 
characteristics of the image. This makes it possible to analyse the content of 
the image in terms of colour, texture and also in terms of semantic content. 

30 However, such devices are not robust for all types of images. 

The invention relates more particularly to the automatic rotation of 
images in viewing devices not receiving any orientation cue from the sensing 
device and based on the orientation of other images. 
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Accordingly, the invention relates to a method for detecting the 
orientation of an image in a set of images, comprising the steps of: 

- choosing a reference image from among the set of images, 

- detecting the orientation of said image as a function of the orientation 
5 of the said reference image. 

It frequently happens that the user takes several images representing 
the same scene, certain images being taken in portrait mode and others in 
landscape mode. The detection of a reference image from among these 
10 images may make it possible to detect the orientation of the other images 
representative of the same scene or of a similar-content scene. This happens 
especially frequently in respect of images representing a person in a 
landscape, the user wishing in certain images to photograph the landscape 
and in others to make the person stand out by taking a close-up shot. 

15 

The invention will be better understood and illustrated by means of 
advantageous, wholly nonlimiting exemplary embodiments and modes of 
implementation, with reference to the appended drawings, in which: 

20 - Figures 1a and 1b represent examples of decomposition into 

subimages, 

Figure 2 represents a decomposition of the subimages into 
blocks, 

25 As indicated in Figures 1a and 1b, in the target image whose 

orientation is sought as well as in a reference subimage is positioned a 
subimage. 

According to Figures 1a and 1 b, the subimages are of smaller size than 
the image in which it is positioned. It is also possible for the subimages to be 
30 identical to the images. 

The two subimages have the same relative size with respect to the 
image in which they are positioned. The two subimages have the same 
width/height ratio. 
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In the case where one or both subimages are smaller than the 
respective image in which they lie, the subimage is positioned in such a way 
as to obtain a minimum distance between the subimage of the reference 
image and the subimage of the target image whose orientation one wishes to 
5 detect To this end, several positions of the subimages are tested and the best 
position is retained. 



In another embodiment, the subimage is positioned at the centre of the 
image for the reference image and for the target image. 

10 In another embodiment, the subimage is positioned according to a fixed 

rule depending on the class of the image. This presupposes that the image is 
classed previously according to a type which may for example be the type of 
scene (town, landscape, interior scene, person, etc.). It is possible to define a 
rule as follows: for landscape and interior scenes, the subimage is placed in 

15 the centre of the image; for town scenes, the subimage is placed at the 
bottom of the image. 



In yet another embodiment, the subimage is placed according to a fixed 
rule depending on the presence and on the position of objects in the image. 
20 This involves the prior detection of objects in the image. Object can also 
include face. The rule possibly then being to centre the subimage on the 
object. 



When the subimages are positioned in the reference image and in the 
25 target image, four measurements of visual distance are performed. The four 
measurements are performed: 

- -between the subimage of the target image and the subimage of 
the reference image, 

- between the subimage of the target image and the subimage of 
30 the reference image having undergone a rotation of 90 degrees, 

- between the subimage of the target image and the subimage of 
the reference image having undergone a rotation of 180 degrees, 

- between the subimage of the target image and the subimage of 
the reference image having undergone a rotation of 270 degrees, 



WO 2005/069219 



4 



PCT/EP2005/050022 



To do this, the subimages of the reference image and of the target 
image are sliced up into blocks A*B, A vertically and B horizontally. Figure 2 
illustrates an example of the slicing into blocks, where A and B are equal to 2. 
5 This slicing is aimed at complying with the non-stationarity of the 

images processed (the various zones of the images exhibit very different 
contents). The higher the number of blocks, the more this effect will be taken 
into account. 

The number A*B should not however exceed a certain threshold 
10 depending on the resolution of the images in order to contain enough 
information. 

The four measurements of distance D between the target image and 
reference image are calculated thus: 

15 

(A*B)-1 

d= X>,A 

The distances Dj represent the four distances DO, D1 , D2, D3 between 
the four blocks of the images, as indicated in Figure 2. 
20 A weighting factor w s is applied for each block. The weighting can 

depend either on a classification of the blocks according to their significance 
or on a measure of confidence in respect of the calculation of the distances. 

Each distance Dj is calculated from M particular distances d m according 
25 to the following formula: 

M-l 

A = E v »^ 

ro-G 

m representing the number of descriptors used for the calculation of a 
distance. The descriptors possibly being colour, texture for example. 

30 

The calculation of the distance d m is carried out using processes known 
to the person skilled in the art. It is possible to effect colour histogram 
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differences, contour histogram differences, the difference of subband 
energies, the difference of responses of directional filters so as to measure 
these distances. 

5 A weighting factor v m is applied for each distance d m so as to take 

account of the confidence of calculation of the m distances. 

The reference images are images whose orientation is known a priori. 
The orientation of these images may be obtained through various methods, 

10 and in particular by detecting for example objects in these images or faces, 
but it is also possible to index them manually by the user. It is also possible to 
use methods different from the method proposed by the present invention 
making it possible to detect the orientation of an image and these methods 
may be used to detect the orientation of the reference image. Such a method 

15 is described for example in European Patent Application 1107182 filed in the 
name of the company Eastman Kodak Company on 17 November 2000 and 
entitled "determining orientation of images containing blue sky". 

When several reference images are available to the method, the choice 
20 of the reference image is performed by making a calculation of J distances Ej 
between the given image and the reference images available to the method. 

Each distance Ej is calculated from L particular distances ei according 
to the following formula: 

25 Ej^Y,q x e x 

1=0 

A weighting factor qi is applied to each distance ei calculated. 
Each distance ei calculated is calculated according to known 
processes, as indicated previously in respect of the distances d m . 

30 

The reference image for which the distance with the target image is the 
smallest is then chosen. 
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Subsequently the measurements of distances Dj such as indicated 
previously are calculated as is D. 

D is therefore calculated between the target image and the reference 
image in four positions (turned by 0, 90, 180 or 270 degrees). 
5 The smallest distance indicates the rotation that the target image must 

undergo in order to be viewed in the correct sense. For example, if the 
smallest distance is that between the target image and the reference image 
turned by 270 degrees, then the target image must be turned by 207 degrees 
so as to be viewed in the correct sense. 



